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Abstract 



^ ■ In this paper we study the functional central limit theorem for stationary Markov chains 

^ ! 

l/^ , with self-adjoint operator and general state space. We investigate the case when the variance 

^SJ ■ of the partial sum is not asymptotically linear in n, and establish that conditional conver- 

. gence in distribution of partial sums implies functional CLT. The main tools are maximal 

inequalities that are further exploited to derive conditions for tightness and convergence to 
the Brownian motion. 

•i— I r 

■ -■• 1 Introduction 

Kipnis and Varadhan (1986) showed that for an additive functional zero mean Sn of a station- 
ary reversible Markov chain the condition var{Sn)/n — )• implies convergence of S[nt]/V^ 
to the Brownian motion (here, [nt] is the integer part of nt). There is a considerable amount 
of papers that further extend and apply this result to infinite particle systems, random 
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walks, processes in random media, Metropolis-Hastings algorithms. Among others, Kipnis 
and Landim (1999) considered interacting particle systems, Tierney (1994) discussed the ap- 
plications to Markov Chain Monte Carlo. Wu (1999) and Zhao and Woodroofe (2008) studied 
the law of the iterated logarithm, Derriennic and Lin (2001) and Cuny and Peligrad (2010) 
investigated the central limit theorem started at a point. 

Recently, Zhao et al. (2010) addressed the conditional central limit theorem question 
under the weaker condition var{Sn) = nh{n), where h is a slowly varying function (i.e. 
lim„^oo h{nt)/h{n) = 1 for all t > 0). They showed by example the surprising result that 
the distribution of S\^n{^/ stdev{Sn) needs not converge to the standard normal distribution in 
this case. They developed sufficient conditions for convergence to a (possibly non-standard) 
normal distribution imposed to an approximating martingale. 

In this paper we address the question of functional central limit theorem for the case 
considered by Zhao et al. (2010). Our goal is to establish sufficient conditions imposed on 
the original sequence. We also show that for reversible Markov chains conditional convergence 
in distribution of partial sums properly normalized implies functional CLT. The main tools 
to prove this result are new maximal inequalities based on a triangular forward-backward 
martingale decomposition and tightness results. 

Our paper is organized as follows: Section 2 contains the definitions, a short background 
of the problem and the results. Section 3 is devoted to the proofs. Section 4 contains a 
functional central limit theorem for an additive functional associated to a Metropolis-Hastings 
algorithm, with the variance of partial sums behaving asymptotically like nh{n) (where h is 
a slowly varying function). All throughout the paper =^ denotes weak convergence, [x] is the 
integer part of x and —>-'^ denotes convergence in probability. The notation a„ ~ 6„ means 
o-n/^n 1 as n ^ oo; Qn = o(6„) mcans an/bn SiS n ^ oo. 

2 Definitions, background and results 

We assume that (^n)n€Z is a stationary Markov chain defined on a probability space (fi, J^, P) 
with values in a general state space {S,A). The marginal distribution is denoted by tt{A) = 
P(^o € A). Assume there is a regular conditional distribution for given denoted by 
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Q{x,A) = P(^i £ A\S^Q = x). Let Q also denote the Markov operator acting via {Qf){x) = 
Js ds). Next, let LQ(7r) be the set of measurable functions on 5 such that / f'^dir < oo 

and f fdiT = 0. For some function / GLQ(7r), let 

n 

X^ = /te), Sn = an = i'&Slf/^ (1) 

i=l 

Denote by the cr-field generated by with i < k. 

For any integrable random variable X we denote Efc(X) = K(X\J^k)- Under this notation, 
Eo(Xi) = (Q/)(^o) = E(^il^o)- We denote by \\X\\p the norm in Lp(17, J",P). 

The Markov chain is called reversible if Q = Q* , where Q* is the adjoint operator of Q. 
The condition of reversibility is equivalent to requiring that {Co,^i) and Co) have the same 
distribution or 

/ Q{uj,B)TT{duj) = / Q{uj,A)Tr{duj) 
J A Jb 

for all Borel sets A,B £ A. 

Kipnis and Varadhan (1986) assumed that 



lim ^ = aj (2) 



/ 



and proved that for any reversible Markov chain defined by ([T]) this condition implies 

- \ajmt), (3) 



'n 

where W{t) is the standard Brownian motion. 

Recently Zhao et al. (2010) analyzed the case when 

cj^ = nh{n), with h a slowly varying function. (4) 

In their Proposition 1, they showed that without loss of generality, one can assume that 
h(n) —7- oo, since otherwise either ^ holds, (and this case is already known) or 25'„ = 
(1 + {—l)^^^)Xi a.s. Then, in their Proposition 2 they showed that the representation 
implies 

||IEo(5„)||2 = o(a„). (5) 

On the other hand it is well known that ([5]) implies (jl]); see for instance Lemma 1 in Wu and 
Woodroofe (2004). Therefore, we can state Proposition 2 in Zhao et al. (2010) as follows: 



Proposition 1 For a stationary reversible Markov chain defined by the rela- 

tions and ^ are equivalent. 

In their Corollary 2, Zhao et al. (2010) gave sufficient conditions for the validity of 
the conditional CLT in terms of conditions imposed on the differences of an approximating 
martingale. In addition, they provided an example of reversible Markov chain satisfying ([!]), 
for which the central limit theorem holds with a different normalization. 

Throughout this paper we shall assume that cj^ — )■ cxd. 

By conditional convergence in distribution, denoted by Yn\Fo we understand that 

for any function g which is continuous and bounded 

Eo(9(^n)) -^^ ^9{Y) as n ^ oo. 

In other words, let be the probability associated with the Markov chain started from x 
and let be the corresponding expectation. Then, for any e > 

-K{x:\^'g{Yn)-^g{Y)\ > e} ^ 0. 

One of our results is the following invariance principle for functionals of stationary re- 
versible Markov chains. Define 

W^{t) = ^-^ 

Theorem 2 Assume {^n)n&'L is a stationary reversible Markov chain as defined above. Define 
{X,i),i^l by ([ip and assume that is satisfied and Sn/cTn is conditionally convergent in 
distribution to L. Then, 

Wn{t)^cW{t), (6) 

where W{t) is a standard Brownian motion and c is the standard deviation of L. 

Theorem [2] does not require special properties of the Markov chain such as irreducibility 
and aperiodicity. However, if these properties are satisfied we have the following simplifica- 
tion: 
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Corollary 3 Assume {(,n)n€Z is a stationary, reversible, irreducible and aperiodic Markov 
chain such that ^ is satisfied. Then Sn/cTn =^ L implies 

The proof of Theorem [2] requires the development of several tools. First, we shall establish 
maximal inequalities that have interest in themselves. As in the Doob maximal inequalities 
for martingales, we shall compare moments and tail distributions of the maximum of partial 
sums with those of the corresponding partial sums. 

Proposition 4 Let {Xi)i^i be defined by ^ and Q = Q* . Let p > 1 and q > 1 such that 
l/p+l/q = l. Then for all n > 1, 

II max l^il ||p<|| max \Xi\ \\p + (Aq + 3) max ||5j||p. (7) 

l<i<n l<i<n l<j<n 

Remark 5 Let p = 2. Since {Xi)i^i is stationary it is well known that 

II max \Xi\ II2 = o(n^/^) as n —)• 00. 

l<i<n 

If we assume in addition liminf^u^/n > Q we deduce that there exists C > 0, such that 

II max IS'jl II2 < C max ||S'j||2- 

l<i<n l<i<n 

For the proof of tightness, it is also convenient to have inequalities for the tail probabilities 
of partial sums. We shall also establish: 

Proposition 6 Let {Xi)i^z be defined by and Q = Q* . Then, for every x > and n > 1, 
P(max IS'il > x) < -[18E|S'„|/(|S'„| > x/12) + 55 max ||Eo(S'i)||i + || max |Xi| ||i]. 

l<i<n X l<i<n l<i<n 



An important step in the proof of Theorem [2] is the use of tightness conditions. We 
shall give two necessary conditions for tightness, that will ensure continuity of every limiting 
process. 

Proposition 7 Assume Xi is defined by (CP, condition ^ is satisfied and one of the follow- 
ing two conditions holds: 

5 



1. (5^/cr^)„>i is uniformly integrable; 

2. Sn/cTn is Convergent in distribution. 

Then, Wn{t) is tight in D(0, 1) endowed with uniform topology and any limiting process 
is continuous. 

Finally, we give sufficient conditions for convergence to the standard Brownian Motion. 

Proposition 8 Assume {£,n)n& is a stationary reversible Markov chain. Define {Xi)i^z by 
m) and assume that ^ is satisfied. Assume {S'^/cr'^)n>i is uniformly integrable and 

lim = 0. (8) 

n-s-oo (T„ 

Then, 

Wn{t)^W{t). 

3 Proofs 

We start with a preliminary martingale decomposition that combines ideas from Wu and 
Woodroofe (2004) with forward-backward martingale approximation of Meyer and Zheng 
(1984) and Lyons and Zheng (1988). 

3.1 Forward-backward martingale decomposition 

As in Wu and Woodroofe (2004) for n > 1 fixed, define the stationary sequences 

^ n—l 

e^ = -y^Ek{Xk + ... + Xk+^), and 

D-,=ei-Ek-i{9l). (9) 



Then, {D^)k^z is a triangular array of martingale differences adapted to the filtration 
<y{ii-,i < n). Notice that 

1 ""^ 1 

^fc = ^fc "I — / ,lEfc(5fc+i — Sk) = Xk + Efc(0^, ]^) Ek{Sk+n — Sk) 

i=l 

= Xk + 61^1 — -Dfe+i — —EkiSk+n — Sk). 
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Therefore, 

= -C'fc+l + ^fc ~ + —^kiSk+n — Sk). (10) 

We construct now a martingale approximation for the reversed process adapted to the fil- 
tration Gn = > n). We introduce the notation Ei(Xo) = E(Xo|^i) = E(Xo|^i) = 

{Q*mi)- 

Now, let 

^ n— 1 

~ei = -y^tk{Xk-i + ... + Xk). 

With this notation 

Xk+l = Dk + Ok+l ~ ^fc "I ^k+l{X-n+k+l + ■■■ + Xk). (11) 

n 

where D'^ are martingale differences with respect to the filtration Gk = (^{di^ ^ k), DJ^ = 

~ei-^k+iei. 

If we assume that Q = Q*, we have ]Ei(Xo) = E(X2|6) = (Q/)(6)- Therefore, = O^, 
^k+i = ^k+i aiid Ek+i{X_ri+k+i + ... + Xfc) = Efc+i(Xfc+2 + ... + Xfc+„+i). Adding relations 
(flOD and dm leads to 

-'^fc + -'^fc+i = ^fc+i + -^'fc H — IEfc(S'„ — Sk) H — Efc+i(S'fc+„+i - Sk+i). 

n n 

Summing these relations we obtain the representation 

y^{Xi + Xi+i) = V[(A" + + -E._i(5„+i_i - 5i_i) + -E,(5„+i - Si)]. 

1=0 1=1 

So, 

k 

2Sk + (Xo - Xfc) = j;(A" + A-i) + 

i=l 

where 

1 

-Rfc = — / jEi_i(5„+i-i — Sj-i) +Ej(5'n+j — Si)]. 

i=\ 

Therefore, in the reversible case, we get the following backward-forward martingale represen- 
tation 

Sk = \[{Xk - Xo) + {MJ: + M]}) + Rl], (12) 
7 



where MJ^ = J2i=i 

is a forward martingale adapted to the filtration Tk and MJ} = 
'^iZo ^? ^ backward martingale adapted to the filtration ■ 

Also, it is convenient to point out a related martingale approximation, which helps us 
relate the partial sums with a martingale adapted to the same filtration. Notice that 



^ n— 1 

Xk-\ — > ^ Ek{Sk+i — Sk) = Xk + 91, 

n ^ — ^ 



n 

i=l 



1 

where 0"^ = - V Efc(5fc+i - 5^). 
n ^-^ 

i=l 

Starting from ()10p and using this notation we obtain 

1 

So, summing these relations, denoting as above = Yli=i '^^ obtain for every station- 
ary sequence, not necessarily reversible, and for any n and m, 

Sm = + R^, (13) 

^ m— 1 

where = 6^ - 9^;^ + MSk+n - Sk). 

k=0 

3.2 Proof of Proposition [4] 

We start from (I12p and take the maximum on both sides. We easily obtain 

max \Si\ < -{\Xo\ + max \Xi\ + max \Ml' + Ml'\ + max \Kl\). (14) 

l<i<n 2 l<j<ri l<j<n l<j<7i 

Notice that 

1 " 

max < - V(|Ei_i(5„+,_i - 5i_i)| + \Ei{Sn+i - 5,)|), 
l<i<n n ^ — ' 

i=l 

whence, by Minkowski's inequality and stationarity, for any p > 1 

2 " 

II max I i?," I ||p< - V||Ei(5„+i-5i)||p = 2||Eo(S„)||p. (15) 
l<j<n n — 

i=l 

Taking into account that maxi<fc<n |M^| < |M^| + maxi<fc<„ \M^ — MJ^\, we easily deduce 
II max iMr + M^I |L < || max IM^I |L + || max - M2\ |L+||M;^|L, 
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whence, by Doob maximal inequality applied twice, stationarity and reversibility, 
II max \M^ + K\ ||p<g||M„"||p + (g + l)||M„"||p = (2g + l)||M„"||p, 

l<fc<n 

(where q is the conjugate of p). 

From (fT3j) we have iW^ = Sn — Rn, and from Minkowski's inequality we deduce that 

2 

||M;^||p < ||5„||p + -^||Eo(5i)||p + ||Eo(5„)||p 



n 
i=0 



whence. 



iM^llp < ||5„||p + 3 max ||Eo(5i)||p. (16) 

l<i<n 



From (|14p . (jl5|) and (|16p we deduce the following extension of the Doob maximal inequality 
for reversible processes: 

II max \Si\ \\p < -^(ll^ollp+ll max |Xi| ||p+(2g+l)[||S'n||p+3 max ||Eo(5j)||p]+2||Eo(5„)||p). 

l<i<n Z l<i<n l<i<n 

Taking now into account that ||Eo(5'j)||p < ||5'i||p, Proposition H] is established. <0 
3.3 Proof of Proposition [6] 

For the proof of this proposition we shall use the following claim that can be easily obtained 
by truncation: 

Claim 9 Let X and Y he two positive random variables. Then for all x > 

EXI{Y >x)< EXI{X > x/2) + |p(y > x). 
For every x > 0, using we obtain 
P( max IS'il > x) < P( max |Mf + M^'l > x) + P(|Xo| + max \Xi\ + max |^,"| > x). (17) 

l<i<n l<i<n l<i<n l<i<.n 

Applying the Markov inequality, then the triangle inequality followed by (jlSp with p = 1, 
leads to 

P(|Xo| + max \Xi\ + max \R1\ > x) < -(|| max \Xi\ ||i + ||Eo(S„)||i). (18) 

l<i<n l<i<n X l<i<n 



By triangle inequality and reversibility 



P( max |Mf + I > x) <¥{ max |Mf | > x/3) + 

l<i<n l<i<n 



n 



+P( max I y A"l > 3^/3) + > x/2>) < 3P( max |Mf | > x/S). 

fc=i 

Then, by Doob maximal inequality and the above Claim applied to X = |M^| and Y = 
maxi<j<„ |M"| we obtain 

P(max \M^\ > x/3) < -E|M"|/(max |M"| > x/3) 

l<i<n X l<i<n 

< -E|M„"|/(|M„"| > x/6) + ^P( max |M-| > x/3), 

X 2 l<i<n 

implying 

P( max m > x/3) < -E|M^|/(|M-| > x/6). 

l<i<n X 

Now, we express the right-hand side in terms of S„. By (fT3]l we have M" = Sn — Rn and 
using the fact that for all positive real numbers x, y, a we have {x + y)I{x + y > a) < 2x1 {x > 
a/2) + 2yl{y > a/2) < 2xl{x > a/2) + 2y, we obtain 

E|M;^|I(|M;^| > x/6) < 2E\Sn\I{\Sn\ > x/l2) + 2||K||i 
< 2E\Sn\I{\Sn\ > x/12) + 6 max ||Eo(5i)||i. 

l<i<n 



Therefore, 



(max |Mf| > x/3) < -[2E|5„|/(|S„| > x/12) + 6 max ||Eo(5i)||i] 

l<i<n X l<i<n 



and so 



1 8 

P( max + M^| > x) < — [2E|5„|/(|5„| > x/12) + 6 max ||Eo(5,)||i]. (19) 

l<fc<?i X l<i<n 

Thus, (HZ]), ([H]) and ([HD lead to 

P(max \Si\ > x) < -[ISElS'nl/dS'^l > x/12) + 55 max ||Eo(S'i)||i + || max \Xi\ ||i]. 

l<j<n X l<i<n l<i<n 
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3.4 Proof of Proposition \7\ 

We prove first the conclusion of the proposition under the assumption that {S'^/a'^)n>i is 
uniformly integrable. 

By stationarity and by Theorem 8.3 in Billingsley (1968) formulated for random elements 
of D (see page 137 in Billingsley, 1968) we have to show that for all e > 

lim lim sup ^P( max 15^1 > ec7„) = 0. (20) 

5^0+ n->oo S l<k<[n5] 

By Proposition [6l 

P( max |5fc| > ean) < —[l8E\S,„s]\I{\SinS] \ > ean/l2)+ (21) 

l<k<[n5] eOn 

55 max E|Eo(S'i)| +E max iXjll. 

\<i<\nS\ \<i<n 

We shall analyze each term from the right-hand side of inequality ()2ip separately. 

By the fact that lim„^oo (^^^^j /<Jcr^ = 1, taking into account uniform integrability of 
{S\la^n>\ leads to 

lim lim sup j^E|S'[„5] |I(|5[„5] | > ^) < 

lim lim sup — ^E5'2/(-L^^ > — ^tttt) = 0. 
By stationarity and the fact that liminf„ cr^/n > we have 

^(E max \Xi\f < ^E max iXjP as n oo. (22) 

C„ l<i<n CJ^ " ' ■ ' 

Then, by condition ([5]) and Proposition [H 



4t max (E|Eo(5i)|)^ < 4t max E[Eo(5i)l2 ^ as n ^ oo. (23) 
ai i<i<M ai i<i<M 

Then, combining the last three convergence results with the inequality (j2ip leads to (j20p . 

To prove the second part of this proposition, assume now that 5'„/ct„ =^ L. By Theorem 
5.3 in Billingsley (1968), we notice that the limit has finite second moment, namely 

EL2<lim inf \\Sn\\l/(Tl = l. (24) 
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Furthermore, since (|>S'„|/(T„)„>i is uniformly integrable (because E5^/(T^ = 1), by (0) and 
Theorem 5.4 in BiUingsley (1968), it follows that 

hm sup — E|S[„5]|/(|5[„5]| > ^) < ^7 1™ -^nS[n5]\H^-^ > -^7=) (25) 

= ^E|L|/(|L| > ^ ^ 



V6 24.V6 
By passing to the limit in relation (f2T]) and using (|22]l . (|23]) . and (|25]) we obtain, 



Then, clearly 



lim sup ^P( max ISfc] > eo-„) < -^E|L|/(|L| > -^^). 



lim sup ^P( max > ecj„) < ^ ^^ EL^/(|L| > ^ 



(5 i<fc<[n<5] e 24\/5 

Finally, taking into account (p^ , the conclusion follows by letting (5 — )■ 0+ . 

3.5 Proof of Theorem El 

Because conditional convergence in distribution implies weak convergence, it follows that 
Sn/(^n =^ L. Then, by the second part of Proposition [71 Wn{t) is tight in C(0, 1) endowed 
with uniform topology with all possible limits in C(0, 1). Now, let us consider a convergent 
subsequence, say Wn'{t) =^ X{t). Then X{t) is continuous and since Sn/cTn is conditionally 
convergent in distribution, X{t) has independent increments (by the next lemma in this 
subsection applied on subsequences). It is well known [see, for instance, Doob (1953)] that 
the process X(t) has the representation X{t) = at + bW{t) for some constants a and b, where 
W{t) is the standard Brownian motion. Without restricting the generality, by symmetry, we 
can assume 6 > 0. To identify the constants, we use the convergence of moments in the limit 
theorem, namely Theorem 5.4 in BiUingsley (1968). Notice that (5'„/fT„)„>i is uniformly 
integrable in Li since it is bounded in L2. We use this remark to obtain 

EL = lim ESn/cTn = = lim EW„/(1) = EX(1) = a + 6ET^(1) = a, 

n— >-oo n'— >oo 

SO a = 0. Finally, by the same argument it follows that 

lim E\Sn\/cTn = E|L| = lim E|VF„/(1)| = E|X(1)| = 6E|W(1)| = 

12 



and so 6 = ¥J\L\^/t^. It follows that X{t) = {¥J\L\^/t^)W {t) . In particular it follows that 
L has normal distribution and therefore E|L| \/vr/2 is the standard deviation of L. 

Lemma 10 Under the assumptions of Theorem\^ ifWn{t) =^ ^it), then X{t) has indepen- 
dent increments. 

Proof. Without loss of generality, for simplicity we consider only two increments. For any 
0<s<t<l, we shall show that 

{Wn{s),Wn{t)-Wn{s)) {X (s) , X (t) - X {s)) 

where X{s) and X{t) — X{s) are independent. By the Cramer- Wold device it is enough to 
show that for any two real numbers a and b, 

A = Eexp[iaWnis) + ib(Wn{t) - Wn{s))] 
-Eexp[iaX{s)]Eexp[ib{X{t) - X{s))] 0. 

To see this, notice that 

Eexp[iaWnis) + ib{Wn{t) - Wnis))] 
= Eexp[mVF„(s)]E[„,] exp[ib{Wnit) - Wn{s))]. 

By adding and substracting ¥, exp[iaWn{s)]K exp[ib{X (t) — X{s))] to A, we easily obtain 

\A\ <E\E[.^,]exp[ib{Wn{t) -Wn{s)] -Eexp[ib{X{t) - X{sm + 
+\Eexp[iaWnis)] - E exp[iaX {s)]\ =1 + 11. 

Since we assume that Wn{s) =^ X{s), it follows that // — 0. Furthermore, by dH, X{s) and 
s^/^L are identically distributed. 

To treat the term /, notice that by stationarity and the definition of Wn{t) we have that 

/ = E|Eoexp[i6(5[„t]_[„,]/a„)] -Eexp[i6(X(t) - (26) 

Because we assume that dn — )• oo we have 

El^j^tj.fns] - S[n(t-s)]\ 0, (27) 
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which easily imphes that for all b, 

E|Eoexp[i6(5[„t]„[„^]/cr„)] - Eq exp[i6(5[„((_3)]/o-„)]| 0. (28) 

Now, since S[n(t-s)]/cn =^ X{t — s) and S^^t] ~ S[ns]/(yn ^(^) — ^{s), we deduce from (j27|) 
and stationarity that X{t — s) and X{t) — X[s) have the same distribution. Furthermore, by 
dH, we deduce that S\^n{t-s)]/ '^n is also conditionally convergent in distribution; so, we also 
have X{t — s) is distributed as {t — sY^^L. Whence, by taking also into account (p6]) and ([28|) 
it follows that 

lim sup / = lim sup E|Eo exp[i6(S'[„((„s)]/(T„)] — Eexp[-ife(X(t — s))\\ = 0, 

ra— )-oo ra— >cxD 

leading to the conclusion. 
3.6 Proof of Corollary [3] 

The proof of this corollary follows the lines of Theorem [2] with the exception that we replace 
Lemma [10] by the following Lemma: 

Lemma 11 Under the assumptions of Corollary if Wn(t) =^ X{t), then X{t) has inde- 
pendent increments. 

Proof. We mention that by the fact that the Markov chain is stationary, irreducible and 
aperiodic it follows that it is absolute regular [see Theorems 21.5 and its Corollary 21.7 in 
volume 2 of Bradley (2007)]. It is well known that an absolutely regular sequence is strong 
mixing [see the chart on page 186, volume 1, Bradley (2007)]. This means that a„ \ where 

an = sup¥{A DB)- ¥{A)F{B); 

here the supremum is taken over all A £ (y{ii^ ^ < 0) and B £ (y{ii^ i > n). Because we know 
from the proof of Theorem [2] that the process X{t) is continuous, it is enough to show that 
for all k and < si < ti < S2 < ^2 < ... < Sfc < < 1 the increments {X{ti) — X{si))i<i<k 
are independent. Now, using the definitions of q„ and Wn{t), we get by recurrence 

|P(nii(Ty„(ti - s,) E A^)) - ntiP(H^„(t, - Si) e Ai)\ < 

^<min_^a[n(s,+i-t.)] ^ as n ^ oo. 
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for any Borelians Ai, Aj.. The conclusion follows by passing to the limit with n. 



3.7 Proof of Proposition [8] 

By Proposition ([1]) we know that cr^ = nh{n) with h a function slowly varying at infinity. 
Then, by the first part of Proposition [71 Wn{t) is tight in D(0, 1). It remains to apply Theorem 
19.4 in Billingsley (1968). 

4 Application to a Metropolis-Hastings algorithm 

In this section we analyze a standardized example of a stationary irreducible and aperiodic 
Metropolis-Hastings algorithm with uniform marginal distribution. This type of Markov 
chain is interesting since it can easily be transformed into Markov chains with different 
marginal distributions. We point out a central limit theorem under a normalization other 
than the variance of partial sums. Markov chains of this type are often studied in the literature 
from different points of view, as in Doukhan et al (1994), Rio (2000 and 2009), Merlevede 
and Peligrad (2010). The idea of considering Metropolis-Hastings algorithm in this context 
comes from Zhao et al. (2010). 

Let E = [—1, 1]. We define now the transition probabilities of a Markov chain by 

Q{x,A) = {l-\x\)5,{A) + \x\v{A), 

where 5^ denotes the Dirac measure and v on [—1,1] satisfies 

v{dx) = \x\dx. (29) 
Then, there is a unique invariant measure, the uniform distribution on [—1,1], 

7r{dx) = dx/2, 

and the stationary Markov chain (^j)j with values in E and transition probability Q{x,A) is 
reversible and positively recurrent. Moreover, for any odd function / we have 

QHmo) = E(/(6)I6) = (1 - leol)V(Co) a.s. (30) 
For the odd function f{x) = sign x, define Xi = sign ^j. In this context we shall show: 

15 



Example 12 Let (Xj)j>i defined above. Then (T^/(2nlogn) 1 and 

1 t"*' 1 

where W{t) is the standard Brownian motion. 

Proof. For any m >0 we have 

E(XoX„0=E(/(Co)Q"'(/)(Co))= / (l-Nr7r(dx) = l/(m + l). 

Je 

Therefore, by simple computations, we obtain 

cr^ ^ 2n log n as n — >■ oo. 

Now, to find the limiting distribution of Sn properly normalized, we study the regeneration 
process. Let 

To = inf{i >0:Ci^^o} 

and 

Tfc+i = inf{i > Tfc : ,f i / ^i-i}, Tfc = Tfc+i - T^. 

It is well known that (^Tfc)T"fe)fe>i s^re i.i.d. random variables with ^^-fc having the distribution 
V. Furthermore, 

P(ri > n\^r^ =x) = {l- \x\r. 



Then, it follows that 



E(Ti|^ri = a;) = A and E(ti) = 2. 



So, by the law of large numbers T^/n 2 a.s. 
Let us study the tail distribution of ri . Since 

P(ri|X,J > y\^r, =x) = P(ti > y\U = x) = {1 - 

by integration we obtain 

P(ri >y) = J (1 - \x\)y\x\dx = 2 J (1 - xfxdx ~ 2^"^ as y ^ oo. 
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Moreover, ¥,{TkXT-^) = by symmetry. Also 

H{y)=EiTfl{n < y)) ~41ny. 



Define a normalization satisfying 6^ ~ nH{hn)- In om' case, 6^ ~ 4nln6„, implying that 



For each n, let rUn be such that T„i„ < n < Tm„+i- 
We have the following representation 

n [n/2] m„ [n/2] „ 

^Xk-Y,Yk = iTo-l)Xo + iY,rkXr,-^rkXr,)+ ^ X,, (31) 

fc=l k=l k=l k=l k=Tmn+i 

where = t^Xt-^ is a centered i.i.d. sequence in the domain of attraction of a normal law. 
By the limit theorem for i.i.d. variables in the domain of attraction of a stable law [see Feller 
(1971)] we obtain, 

■ iV(0,l). (32) 



l^k=l 



b[n/2] 

By Theorem 4.1 from Bilhngsley (1968) the CLT for (ELi ^fc)/^[n/2] will follow from (HI] 
and (j32p provided we show that the normalized quantity in the right-hand side of (j3ip con- 
verges in probability to 0. Clearly, because ^[n/2] — oo we have 

{To - l)Xo 



0. 

b[n/2] 

Also, 



^[n/2] ~ ^[n/2] ^[n/2] 

Therefore it remains to study the middle term. Let 6 > 0. 



mn [n/2] 



n 

k=l k=l 

I [n/2] 

+P( max I y n - y i^l > e^[„/2l) = 1 + 11 

^n/2-&n<l<n/2+&n ^ ^ ki |n/^j/ 

fc=l fc=l 

Then, by the definition of and the law of large numbers for the i.i.d. sequence (rj)j>i we 
know that: m„/n — )• 1/E(ri) = 1/2 a.s. Therefore the first term converges to for every 6 
fixed as n — )• oo. As for the second term, by stationarity and the fact that Yk are i.i.d. 



II <2n jn^^\Y.Yk\> ehn/2]m 

l<t< dTi +1 7 



k=l 
17 



and Theorem 1.1.5 in De la Pena and Gine (1999) 




1/ < 2 P( max 

l<l<[5n] + l 



> eb[n/2]/2) < 18 P(| Yk\> eb[n/2]m- 



k=l k=l 



Then, by the central limit theorem in (j32p and the fact that b'^ 



2n\nn, we have 




lim sup P(| V Yk\> e?^[„/2]/60) = lim sup P(| V Yk\/b[Sn] > e6[n/2]/606[5„]) 

fc=l k=l 

< P(iV(0,l) > e6-^/^/120) 



which converges to as 5 — ?■ 0. 



It follows that 



n 




We recall that = 2nlogn = 6^, implying that 



Consequently, because the chain is irreducible and aperiodic, by Corollary [3l Wn(t) =^ 



For a different example having this type of asymptotic behavior we cite Zhao et al. (2010). 
Our Corollary [3] will also provide a functional central limit theorem for their example. 
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